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REMARKS  CONCERNING  CHASE'S  RESULTS  ON  TESTING  FOR 


ORDERED  ALTERNATIVES 

Tim  Robertson  and  F.  T.  Wright 

ABSTRACT 

--A 

Chase  (Biometrika  (197*0)  found  a  good  approximation  for  the  chi-bar- 
square  (y  )  and  E-bar-square  (E  )  distributions  for  an  important 
special  case.  These  distributions  are  fundamental  to  the  theory  of  order 
restricted  tests.  Chase  had  in  mind  the  problem  of  comparing  ordered  dose 
levels  with  a  control  and  considered  the  case  where  there  are  more  obser¬ 
vations  on  the  control.  He  obtained  a  recursive  relation  for  the  limiting 
values  of  the  coefficients  in  those  distributions  as  the  sample  size  on 
the  control  becomes  infinite  and  the  other  sample  sizes  remain  fixed  and 
equal.  His  approximation  is  the  result  of  an  interpolation  between  criti¬ 
cal  values  in  this  limiting  case  and  critical  values  in  the  case  where  all 
the  sample  sizes  are  equal. 

Starting  with  Chase's  formula  we  derive  a  sharper  recursion  relation 
and  table  the  limiting  coefficients.  This  allows  one  to  determine  approx¬ 
imate  P -values ;  to  use  critical  values  not  included  in  Chase's  tables  and 

to  apply  these  approximations  to  testing  problems  where  other  versions  of 

—2  ‘  —2 

the  X  '  arid  E  distributions  occur. 
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1.  INTRODUCTION  AND  SUMMARY 


The  problem  of  testing  the  equality  of  several  populations  when  these 
populations  are  known  to  satisfy  an  order  restriction  is  discussed  at 
length  in  Chapters  3  and  1*  of  Barlow,  Bartholomew,  Bremner  and  Brunk 
(1972).  The  chi-bar-square  (\  )  and  E-bar-square  (E  )  distributions 
are  fundamental  to  this  theory.  These  distributions  have  tail  probabili¬ 
ties  which  are  linear  combinations  of  chi-square  and  beta  tail  probabili¬ 
ties.  The  coefficients  in  these  linear  combinations  are  the  probabilities 
that  the  order  restricted,  maximum  likelihood  estimates  of  normal  means 
have  a  certain  number  of  distinct  values  (called  levels).  These  coeffi¬ 
cients  depend  upon  the  precisions  of  the  sample  means  as  estimators  of 
the  corresponding  population  means.  (Recall  that  the  precision  of  the 
sample  mean  is  the  reciprocal  of  its  variance  (i.e.  ,  the  quotient  of  the 
sample  size  and  the  population  variance).)  The  computation  of  these 
coefficients  has  been  the  subject  of  a  considerable  amount  of  research. 

If  the  precisions  are  all  equal  and  if  the  order  restriction  is  simple 
then  their  values  can  be  determined  from  the  recursion  formula  given  in 
Corollary  B  on  page  lk5  of  Barlow  et  al.  (1972).  This  case,  which  is 
referred  to  as  the  equal  weights  case,  is  one  of  the  few  (even  for  simple 
orders)  where  computation  of  these  coefficients  is  possible  when  the  num¬ 
ber  of  populations  exceeds  five.  Thus,  approximations  are  of  interest. 

Assume  that  we  have  k+1  normal  means  and  that  they  are  denoted  by 
^0’^l*""’^k'  Consider  the  simple  order  restriction  &M^  s  •  •  •  s M^ 
and  let  denote  the  precision  of  the  sample  mean  associated  with 

;  i  = 0 ,1 ,2 ,  • • •  ,k.  We  will  henceforth  refer  to  these  precisions  as 


n( 
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and/or 
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weights.  Chase  ( 197*0  found  a  good  approximation  for  the  case 
v  =v2  =  •  •  •  =  wfc  while  w^/w^  >  1*  He  had  in  mind  the  problem  of  compar¬ 
ing  the  average  responses,  ,M2 ’  * '  *  ,J*k  ’  of  several  increasing  dose 
levels  with  the  average  response,  M^,  to  a  zero  dose  control.  As  Chase 
noted,  researchers  often  increase  the  sample  size  associated  with  the  con¬ 
trol  over  the  sample  sizes  associated  with  the  nonzero  dose  levels. 

Chase  obtained  a  recursion  relation  for  the  limiting  values  of  the 
coefficients  as  the  sample  size  on  the  control  becomes  infinite  and  the 
other  sample  sizes  remain  fixed  and  equal.  His  approximation  is  obtained 
by  interpolating  between  this  limiting  value  and  the  equal  weights  case. 
Starting  with  Chase's  results  we  develop  a  generating  function  for  these 
limiting  coefficients  which  yields  a  more  elegant  recursion  relation  and 
using  this  relation  we  construct  a  table  of  these  coefficients.  This 
enables  an  investigator  to  obtain,  by  interpolation,  approximate  P-values 
for  these  tests  and  to  use  critical  values  not  included  in  Chase's  tables 
(his  table  is  easy  to  use  if  the  critical  value  of  interest  is  included 
there).  For  a  moderate  number  of  populations,  P-values  can  be  computed 
using  the  table  given  here  and  for  a  larger  number  of  populations  a  simple 
computer  program  can  be  written.  The  recursion  formula  given  here  is  easy 
to  program. 


?.  A  GENERATING  FUNCTION  AND  A  RELATED  RECURSION  RELATION 


We  adopt  Chase's  notation.  Suppose  k  dose  levels  are  to  be  compared 
with  a  contol.  Index  these  treatments  by  the  integers  0  to  k>  with  0 
corresponding  to  the  control  and  assume  that  dose  level  i  is  greater  than 


i-1  for  i  =1,2,  •  •  •  ,k.  We  assume  that  the  corresponding  k+1  popula- 

2 

tions  are  normal  with  means  and  variances  M.  and  a.  and  that  we  have 

i  1 

independent  random  samples  with  sample  sizes  and  means  n.  and  Z. 

11 

(i  =0,1,* • •  ,k).  We  are  interested  in  testing  HQ  :  =  M  = • • •  =  against 

Hi-Ho  with  Hx  :MQ  a:  Mx  js  ...s:  m  . 

To  illustrate  the  results  we  assume  that  the  population  variances  are 
known,  however  the  case  of  unknown  variances  is  discussed  in  the  next  sec¬ 
tion.  If  A  denotes  the  likelihood  ratio,  then 


T  =  -2  In  A  =  £.k=o  w.Cpt-Z)2  (l) 

where  wi=n./o2,  Z  =  Lk=Q  w.  and  pi  =  (^,1^,- •  ■  gives 

the  maximum  likelihood  estimates  (MLE's)  subject  to  the  restrictions  in 
.  (Computation  algorithms  for  £  are  discussed  in  detail  in  Barlow 
et  al.  (1972).)  It  is  well  known  that,  under  Hq, 

P[T*t]  =  P(je,k+l;w)P[x^_1a  t]  (2) 

2 

where  X^  denotes  a  standard  chi-square  variable  with  V  degrees  of 
2 

freedom  (xQ  s  0)  and  P(X,k+l;w)  denotes  the  probability,  under  H^, 
that  the  coordinates  of  have  exactly  X  distinct  values.  (The 
P(A,k+l;w)  are  the  coefficients  discussed  in  the  introduction.) 

Because  the  P(X,k+l;w)  are  computed  under  the  assumption  that  HQ 
holds,  we  may,  in  our  study  of  them,  assume  that  =  • • •  = = 0 .  In 

the  equal  weights  case,  wQ  = w^  =  • • •  = w^ ,  we  denote  these  probabilities 
by  P(A,k+l).  It  is  well  known  (cf.  Corollary  A,  page  lU3  of  Barlow  et  al. 


u 


(1972))  that  the  generating  function  of  the  P(X,k+l)  is  given  by 


Ws>  ‘  '‘-tl 


(3) 


and  that  these  probabilities  satisfy  the  recursion  relation 


P(l ,k+l)  =  kP(l,k)/(k+l)  = (k+l)-1,  P(k+1 ,k+l)  =  P(k,k)/(k+l)  =  [(k+l).' ]-1 
and  P(X,k+l)  = P(  X-l  ,k) /(k+l)  + kP(  X,k ) /(k+l) 


(M 


for  X  =  2,3,'**,k  and  k=l,2,***. 


These  equal  weights  probabilities  are  given  in  Table  A. 5  of  Barlow  et  al. 
(1972)  for  k  *  11. 

As  was  mentioned  in  the  introduction.  Chase  studied  the  limiting  value 

of  P(X,k+l;w)  as  w  — *  w  and  w  =w  =•••  =w  remain  fixed.  We  denote 

U  _L  c.  K 

these  limiting  values,  which  do  not  depend  on  the  common  value  of 
w^ ,w^ , • • • ,w^ ,  by  Q(X,k+l)  for  X=  1,2,* - •  ,k+l.  Chase  proved  the  follow¬ 
ing  recursion  relation: 


Q(X,k+l)  =  Q(l,m+l)P(X-l,k-m)/2X"1;  X  =  2  ,3, •  •  •  ,k+l.  (5) 


k+l 

Of  course,  Q(l,k+l)  can  be  obtained  from  Q(X,k+l)  =  1.  Starting 

with  Chase's  result,  we  obtain  the  generating  function  of  the  Q(X,k+l). 


Theorem.  With  the  Q(X,k+l)  defined  as  above. 


s-1  +  k 

®k+i(s)  =  QU’k+i)si  =  s(  %  )■ 


(6) 
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Proof.  The  first  step  of  the  proof  is  to  determine  Q(l,k+l)  for 
k=0,l,-’*.  Using  (5),  the  fact  that,  for  fixed  k,  Q(X,k+l)  is  a  prob¬ 
ability  distribution,  and  an  interchange  in  the  order  of  summation  we  have 

Q(  1  ,k+l )  =  Q(l,m+1) 

=  1  Q(  1  ,m+l )«  (l/2) , 

m—  u  k-m 

which,  applying  ( 12 . U )  of  Chapter  2  in  Feller  (1968),  becomes 

1  -  «d,»*i)(-i)k-"(-^). 

Now  consider  the  generating  function  of  the  sequence  {Q(l,k+l)]k_0; 

Y(s)  =  l”=Q  Q(l,k+l)sk,  -1  <  s  <  1. 

Using  the  above  expression  for  Q(l,k+l)  and  interchanging  the  order  of 
summation,  we  see  that 

,(s>  --  «<^>°"C4'i^)(-s)k'" 

=  (i-s)_1-ns)[(i-s)-1/2-i] 

and  so  Y(s)  =  (l-s)"1/2  =  Z^=0(”1/2) (-s )*•  Hence, 

Q(  1  ,k+l)  =  (_1k/2)(-l)k  =  (k  ’k/2)-  (7) 

(Note  that  Q(l,k+l)  =  £^(1/2).) 


•< 
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Substituting  (7)  into  (5)  and  using  the  resulting  formula  for 
Q(X,k+l);  X  =  2 ,3 ,  * • •  ,k+l ,  we  write 

w>  -m— 

r  k  /  m  - 1/2  \ / s /2  +  k-m-l\ 

=  sLm=0l  m  )[  k-m  J‘ 


The  identity  (12.16)  of  Chapter  2  in  Feller  (1968),  gives  the  desired  expres¬ 
sion  for  0k+1(s). 

There  is  a  long-standing  conjecture  that  the  sum  of  the  P(X,k+l;w)’s 
for  odd  X  is  equal  to  their  sum  for  even  X  (cf.  page  171*  in  Barlow  et 
al.  (1972)).  If  true,  the  result  would  be  useful  in  computing  the 
P( X,k+l;w)'s .  This  conjecture  is  equivalent  to  stating  that  the  generating 
function  of  these  coefficients  vanishes  at  -1.  It  is  interesting  to  note 
that  ®jc+^(s)  has  a  factor  of  (s+l)  so  that  €^+^(-l)  =  ®  for  k* 

One  could  obtain  the  Q(X,k+l)  by  expanding  the  polynomial 


;  however,  a  recursion  formula  like  the  one  available  for  the 


P(X,k+l)  (cf.  (U))  would  be  easier  to  implement. 


Corollary .  For  k*l,2,***. 


Q(l,k+l)  =  (2k-l)Q(l,k)/(2k),  Q(k+l,k+l)  =  Q(k,k)/(2k)  and 


Q(X,k+l)  =  Q(X-l,k)/(2k)  +  (2k-l)Q(X,k)/(2k)  for  X-2,3, •••,*. 


(8) 
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Proof.  The  desired  results  follow  from  the  identity. 


(s/2  +  k  -  1/2)  /s/2+k-3/2\  s  +2k-l  ^  ,  \ 

k  k-l  j  =  -^k -  0k(s) 


=  s(2k-l)Q(l,k)/(2k)  +  I^2  sX[Q(X-l,k)/(2k)  +  (2k-l)Q(X,k)/(2k)] 

+  sk+1  Q(k,k)/(2k). 


It  is  interesting  to  note  that  Q(k+l,k+l)  =  (l/2)k/k!  =  P(k,k)/2k 

Pk  P 

and  that  Q(l,k+l)  =  (2k)!/(2  (k!)  ). 

Using  the  results  from  the  corollary,  the  Q(X,k+l)  were  computed  for 

1  ^  k  s  11.  Table  1  contains  these  values;  for  k  =  8,9,10  and  11  and 

X  >  8,  the  Q(X,k+l)  are  zero  to  five  decimal  places .  So  in  the  testing 

situation  being  considered  one  could  compute  P-values  in  the  limiting 

case  based  on  the  Q(X,k+l),  in  the  equal  weights  case  based  on  the 

—1/2 

P(X,k+l)  and  interpolate  on  w  where  w  =  w^/w^ .  Chase  found  this 

interpolation  scheme  to  be  very  satisfactory  in  computing  critical  values. 

To  give  some  idea  of  its  accuracy  in  computing  P-values  we  considered 

k=U,  a  situation  in  which  exact  tail  probabilities  can  be  computed, 

w=2,*t  and  t=6,9-  The  exact  values,  with  the  approximations  given  by 

interpolation  in  parentheses,  are  as  follows:  for  w  =  2,  P[T  ^6]  = 

.02915  (.02893)  and  P[T^9]  =  .00670**  (.006770)  and  for  w  =  1*, 

P[T^6]  =  .02575  (.02716)  and  P[T^9]  =  .006080  (.006385).  For  moderate 

k  we  recommend  computing  the  P-values  given  by  (2)  with  the  P(X,k+l) 

from  Table  A. 5  in  Barlow  et  al.  (1972)  and  with  the  Q(X,k+l)  from  Table  1 

-1/2 

and  then  interpolating  on  w  .  For  larger  k  one  might  wish  to  write  a 
computer  program  to  generate  the  P(X,k+l)  and  Q(X.k+l)  recursively 


'4 

-  t 


from  (4)  and  (8),  to  compute  the  appropriate  tail  probabilities  and  to 
do  the  interpolation. 


3-  OTHER  APPLICATIONS 

The  distributional  results  discussed  in  the  last  section  provide 
large  sample  approximations  when  exponential  families  are  considered  (cf. 
Theorem  4.5  of  Robertson  and  Wegman  (1978)).  For  example,  one  might  wish 
to  compare  the  ordered  dose  levels  with  a  control  by  considering  the  pro¬ 
portions  of  individuals  who  exhibit  a  particular  response  to  the  various 
dosages.  If  p^  (pQ)  is  'the  proportion  of  individuals  exhibiting  this 
response  when  dose  level  i  (the  control)  is  administered,  then  one  might 

wish  to  test  H*  :  p  =  p  =  •  •  •  =  p  vs.  H*-H*  where  H*  :p„Sp  s.  ■  •  >  sp  . 

0  0  1  k  10  10  1  k 

* 

Let  p^  ,  i=0,l,***,k,  denote  the  corresponding  sample  proportions,  which 

* 

are  assumed  independent  with  p^  based  on  a  sample  of  size  n^ ,  and  let 
— 

Pj.,  i  *  0 ,1 ,  •  •  •  ,k ,  denote  the  MLE’s  subject  to  the  restrictions  in 

(cf.  page  40  of  Barlow  et  al.  (1972)).  Following  the  arguments  used  to 

prove  Theorem  4.5  and  Corollary  4.6  in  Robertson  and  Wegman  (1978),  we  see 

that  with  p  =  n.o./L^  „  n. ,  the  LRT  statistic,  -21nA,  is  approx- 

i=0  i‘i  i=0  i 

imately  equivalent  to 

T*  =  rpd-?)]"1  L^_0  nj(pi-p)2 

as  n.  — *  “  with  n./n.  — »  w.  f  (0,°°)  for  i=0,l,**-,k.  Furthermore, 

i  i  0  i 

under  the  same  assumptions  on  the  sample  sizes. 


j? 
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P[T**t]  P(X,k+l;w)PtX^_1^t] 

with  P(X,k+l;w)  defined  as  before.  So  T*  is  a  test  statistic  that  can 
be  used  for  large  sample  sizes  and  if  n  =n  =•••  =  and  n  Ai^  =  w  ^  1, 

then  Chase's  results  give  approximate  critical  levels  for  certain  a  or 
the  results  presented  here  can  be  used  to  obtain  approximate  P-values. 

Chase  also  considers  testing  homogeneity  versus  a  trend  in  normal 
means  when  the  variances  are  equal  but  unknown.  The  tail  probabilities 
of  the  LRT  statistic  are  linear  combinations  of  beta  tail  probabilities 
and  the  coefficients  are  the  same  P(X,k+l;w).  Hence,  the  techniques  dis¬ 
cussed  here  apply  in  this  situation  too. 

Robertson  and  Wegman  (1978)  and  Robertson  (1978)  studied  the  problem 
of  testing  an  order  restriction  as  a  null  hypothesis.  The  tail  probabil¬ 
ities  of  the  null  hypothesis  distributions  of  the  LRT  statistics  are  again 
linear  combinations  of  standard  chi-square  and  beta  probabilities.  The 
coefficients  are  the  probabilities  that  the  order  restricted  maximum  like¬ 
lihood  estimates  of  normal  means  have  a  specified  number  of  levels.  The 
results  of  Section  2  provide  approximations  for  these  testing  problems 
for  simple  orders  when  one  weight  is  larger  than  the  others. 

Robertson  and  Wright  (1981)  studied  two  problems  where  the  LRT  sta¬ 
tistics  have  asymptotic  null  hypothesis  distributions  for  which  the  results 
of  Section  2  are  possibly  of  use.  Both  of  these  problems  involve  tests 
concerning  the  relationship  of  the  parameters  of  a  multinomial  population 
to  a  given  set  of  possibilities  for  these  parameters.  One  is  a  test  of 
the  equality  of  these  two  parameter  sets  when  the  alternative  imposes  a 
stochastic  ordering  between  them  and  the  other  is  a  test  of  the  null 


10 


hypothesis  requiring  the  stochastic  ordering.  The  appropriate  null 
hypothesis,  asymptotic  distribution  in  each  case  involves  the  probabili¬ 
ties  discussed  in  Section  2.  The  weights  are  the  parameters  of  the  given 
population  so  that  the  results  here  would  be  applicable  if  one  of  those 
parameters  was  relatively  large  while  the  others  were  (approximately)  equal. 

One  might  be  interested  in  comparing  increasing  doses  with  more  obser¬ 
vations  available  on  an  intermediate  dose  level.  Consider  testing  H  vs. 

0 

(or  H*  vs.  with  w^  =  wQ  for  j  ^i  and  w^  >  wQ. 

Assuming  the  variances  are  known,  the  LRT  statistic  and  its  tail  probabili¬ 
ties  are  still  given  by  (l)  and  (2),  respectively.  We  need  to  find  the 
limiting  value  of  the  P(£,k+l;w)  as  w^  —♦<*>,  call  them  Q^(X,k+l), 

compute  the  P-values  corresponding  to  the  P(Z,k+l)  and  the  Q^.(£,k+l) 

—1  /2 

and  interpolate  on  (w^/wQ)  .  Recall  that  in  computing  the  P(Z,k+l;w), 

we  assume  Mo=M2=''‘  =  =  0.  Intuitively,  as  w_.  — *  °°,  P(£,k+l;v) 

converges  to  the  probability  that  the  MLE,  subject  to  H  and  pi  =  0 , 

has  L  distinct  values.  The  number  of  distinct  values  in  the  restricted 

MLE  is  the  number  of  distinct  values  in  the  estimates  of  Mq>M  , 

plus  the  number  of  distinct  values  in  the  estimates  of  M. ,M.  , , 

l  i+l  k 

minus  one.  Because  these  two  numbers  are  independent  and  Q^(X,k+l) 

=  QU,k+l), 


Q. (i,k+l) 


Q(m,i+1 )Q(X-l-m,k-i+l) . 


(9) 


Hence,  the  Q^(Z,k+l)  can  be  found  from  Table  1  and  their  generating 


A 


function  is 


(10) 


s-1  ,  .  s-1  ,  ,  . 

-s-  +  +  k-i. 


0k,i(s)  =,I!£i  Qiu’k+i)si!  =  s( 2  i  )p” k-i  )• 


(Using  the  techniques  in  Chase's  paper  with  those  developed  here,  a  rigor¬ 
ous  proof  could  be  constructed. )  It  is  clear  that  similar  remarks  could 
be  made  for  the  case  of  unknown  variances. 

One  might  wish  to  compare  increasing  doses  of  two  (or  more)  drugs 
against  a  common  zero  dose  control.  Suppose  that  there  are  k^(k^)  levels 
of  drug  l(2)  considered,  that  the  control  is  again  denoted  by  zero,  that 

the  dose  levels  on  each  drug  are  increasing,  that  the  responses  are  norm- 

2 

ally  distributed  with  means  and  variances  and  <3  and  14  .  and 

0  0  d,i 

2 

0^  ^  for  i=l,2,---,k^  and  d=l,2  and  that  we  have  independent  random 
samples  with  sample  sizes  and  sample  means  n  and  Z  and  n  and 

U  U  Q. )  1 

Zd  i  for  i  = 1,2 , • * • ,k^  and  d  =  1,2.  In  testing  :  MQ  =  ..  for 

i=l,2,---,kd  and  d  =  1,2  vs.  R^-Hg  with  :  MQ  x  s  sMj  k 


and  M0  s  m2  1  S  ’ * '  5  M 


0  ,  ,  the  LRT  statistic  is 

C. 


Ta  ’  vo<&o‘z>2  *  za«i  ”d,illIa,i -z)2 


where  the  weights  are,  as  before,  the  ratio  of  sample  sizes  to  variances, 
k  k 

Z  =  (w.Z.  +z2  w  .Z  .  )/(w  +£*:  v  .)  and 

0  0  d=l  i=l  d,i  d,i  0  d=l  1=1  d,i 

ft  =  (^o’^l  !  *  *  *  *  >^1  k  ,ft2  i’'"’^2,k2  iS  thS  ^  subJect  to  the  restric¬ 
tions  in  H^.  The  hypothesis  imposes  a  partial  order  (not  a  total 

order  as  does)  on  the  collection  of  means  and  a  general  computation 

algorithm  for  £1  in  such  cases  is  the  minimum  lower  sets  algorithm  (cf. 
page  76  of  Barlow  et  al.  (1972)).  Under  H  ,  the  tail  probabilities  of 


12 


are  given  by 

VV1  p 

p[T2n]  =1^  *  Pd^+kg+i^iPt^it] 

where  P(  X^+k^+ljw)  is  the  probability,  under  HQ,  of  exactly  L  dis¬ 
tinct  values  in  u.  We  can  obtain  the  limit  of  P( Xjk^+k^+ljw)  as 
w0  *  00  and  the  other  weights  remain  fixed  and  equal.  As  wQ  — *  ®  , 

P( X,k^+k2+l ;w)  converges  to  the  probability  that  the  MLE's,  subject  to  the 
2 

restrictions  in  with  MQ  =  0,  has  X  distinct  values,  but  this  is 

given  by  (9)  with  i  replaced  by  k^  and  k-i  replaced  by  k^.  If  wQ 
is  significantly  larger  than  the  other  weights  (say  U  times  as  large)  then 
this  limiting  distribution  can  be  used  for  rough  approximations.  However, 
interpolation  with  the  equal  weights  case  is  not  possible  because  the  equal 
weights  probabilities  are  not  known  in  this  case.  It  would  be  of  consid¬ 
erable  interest  to  determine  their  values .  As  an  approximation  to  the 
equal  weights  probabilities  one  could  use  (9)  with  Q(-,i)  replaced  by 
P(#,i)  and  then  interpolate  between  the  values  of  (2)  based  on  the  limit¬ 
ing  values  and  these  approximate  values. 
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